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ABSTRACT 

This report describes the initial planning, 
participant selection, and participant evaluation of 5 1970 American 
personnel and Guidance Association (APGA) Research Training Sessions. 
All were designed specifically to improve the quality of research 
skills and competencies of trained counselor educators. The 5 
sessions, each 5 days long, were entitled; (1) Computer Technology in 
Guidance; (2) Systems Research for Counselors, Counselor Educators 
and Supervisors; (3) Utilising Research to Improve counseling 
Programs; (4) Field Oriented Research in Ecological Studies and 
Development Models for counselors, counselor- Educators, and 
Supervisors; and (5) problems of Research Supervision and 
Consultation. A fairly comprehensive description of each training 
session is provided which includes; (1) purposes and objectives; (2) 
schedule; (3) demographic and other participant data; (4) 
instructional materials; (5) a summary of participants* evaluations 
of the program; and (6) evaluation by the session director. (TL) 
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The APGA research irciining sessions wore designed specif! ccilly io 
improve iho quaiily of research skills and competencies of trained counfclor 
educcitois, ToWCii'ds this OiiJ, APGA v/as fortunate In attracting exceptional ly 
qualified personnel to iniplemcnt the training .program . 

The author of this report wishes to acknowledge the efforts of the many 
Individuals v,'ho mode it possible to conduct the 1970 APGA Research 
Training Sessions, Noted among these, of courre, v/erG the directors and 
staff of the individual sessions, who devoted immcasuroble time and efiort 
toward ensuring high quality of training for the participants. The names 
of these individuals are cited in the report. 

The APGA ResGarch Training Sssslon Committee is to bo commended for 
its diligence in carrying forth the responsibilities assigned to it, particularly 
its selection of high caliber training progroms and directors. 

The centra! staff of the American Personnel and Guidance Association/ 
through the effective guidance and administrative support of Dyckrnan Vermilye, 
should receive special ncknov/ledgement. In many rospacts, the extensive 
efforts of APGA staff in working out planning problems, locating suitable 
meeting facilities and in handling financial arrangements were instrumental 
in effecting the successes programs reported. 

Finally, thanks are due to Mrs. Effie Bynum, who assumed primary 
responsibi ! i iy for the day'"to-day administrative tasks of the Research Training 
Sessions preceeding their operations. 

Edmund 'W, Gordon 
June 1971 
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INTRODUCTION 



PLANNING OF THE RESEARCH TRAINING SESSIONS 
SELECTION OF APPLICANTS AND PROCESSING OF APPLICANTS 
EVALUATION OF THF: TRAINING SESSIONS 
RESEARCH TRAINING SESSION DESCRlPTIOisIS; 

r 



prescssion h 


Compufer Technolog/ in Guidance 


Presession II: 


Systems Research for Counselor's, Cuunseior-Educalore 
and Supervisor's 


presession III* 


Utilizing Research to Improve Counseling Programs 



Prescssion IV* Field Orienleci Research in Ecological SNdies and 

Developmonf Models for Counselors, CounsGlor-Educa 
and Supervisors 



Presession V: 



Problems of Research Supervision and ConsuIlaiTon 



INTRODUCTION 



The American Perssonnel and Guidance AssociaHon conclucrecl five research 



training session, d during 1970. Tour of fhese were held In Nevr Orleans^ March 17- 
21, precedii',g tho 7 nnua! Conveniion of the AssocIaHon. The fifth one was held 
in Chicago, ininols, November 7-11, prior to th© Fall meoting of the North 
Centra! Association for Counselor Education and Supetvision. 



This initial effort of tho Associcition attracted a total of 237 applications. 
Of this numbor, 178 Vv'ore accepted and a total of 128 couiisclors, counselor— 
educators and counselor-supoi'visors were in attendance for the full five-day 
sessions. 



The program vras supportod by a grant from the Research Training branch. 
Bureau of ResDarch, U.S, C^ffice of Education. The parficipants assumod re- 
sponsibility for their own room and board. 

This report describes the initial picsnning, selection, participant evaluation 
of the 1970 APGA Research Training Sessions and the report of session directors. 
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PLANNING 

Early In May of 1969^ a preliminary narraHye proposal for Federal support 
of several five‘^day intensive training programs on research and dev’eloprnenicil 
activities in guidances services was submitted to Mr, Richard Harbeck, Chief of 
the Research Training Branchy National Center tor Educational Researeh and 
Development, Office of Education* Subsequent to this request for funding^ 

a proposal for the establishment of an APGA Research Training Session Committee 
v/as submitted to the Executive Committee of APGA- That Committee^ endorse^ 
ment of the proposal’ was foilowed by an Invitation from the APGA President to 
the Presidents of each of the eight divisions of the association to appoint and fund 
a divisional representative as a memb^^r of the APGA Research Training Session 
Commiltee. Six of the divisions appointed a member and supported his expenses 
to a two-day meeting of the committee in Washington, D-C. on July 8th and 9th- 
The presidenf of APGA designated a seventh person to serve as chairman, fhe 
responsibilities of the committee were outlined cs follows; 

1 . To meet and reviev/ proposais for research training sessions, 
and to select from among available proposals — or suggest 
others that are more appropriate — and forward recommendations 
to the Research Training Branch of the Bureau of Research. . . 

5 



2. To dGicirnine ihe specific criiei’ici to b© appiicd agairist the 
credentials of those v^'ho later submif applications to otiond 

. one or more of the sessions. . , 

3. To implement an ovoroli evaluation of the sessions. Although 
each session director and his staff will be expected to cany 
out his own pre- and post-session evciluatloriS, tiie Committee 
will have to develop or approve a recomniended evaluation 
procedure^ and then consider tho results once thicy have 
been obtained, 

4. To meet Vi'ith the Progixini Directors to help in the cxchangG of 
ideas on structure, procedures, instructional techniques, 
scheduling, paiMicipants selection, the development of 
comfjarable format for evaluating and reporting, and other 
prcblerns that v/ili have become apparent cis the first exper- 
ience of sessions is completed. 

In addition, other specific responsibilities v.'are assigned to the chairman. 
He v/as designed to be 

1 , the official Project Officer 

2, identified in all APGA publicity as the person to whom one 
should v/rite for additional information about any of the 
announced sessions 

3, the one to v/hom all applications would be submitted by those 
who wish to attend a sassion 

4, the one over whcco name the APGA evaluation will be 
distributed 

5, the one who would submit the final report 

The fo! levying individuals served as members of the APGA Research Training 
Session Committee: 

Dr, Edmund W. Gordon, Chairman 

V American Pereonnel and Guidance Association 

Teachere College, Columbia University 

Dr, Thomas L, Blaskovics 

American Rehabilitation Counseling Association 
West Virginia University 

' 6 
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Dr, Donald G, Hays 

American School Counselor As.-oc' iHon 

Fullet'lon Union High Sciioo! Disii'Ici, California 

Dr. Doriald P. j-'o/t 

American Col logo F-’orsonnal Association 
Kansas Staie Unlversliy 

Dr, Danio! Sinick 

Association for Mecisurernent and Evaluation In Guidance 
George Washington UniversHy 

Dr. Otto Spellbichler 

Assoclcition for Counselor Education and Supervision 
Univomity of Maryland 

Dr. David V, Tledeman 

National Vocational Guidance Association 

Harvard University 

The Juno issue of the Guldepost, the official Newsletter of the Association, 
Included a notice about the possibility of resecirch training sessions to the member- 
ship, and an Invitation was extended for reseorch training topics centered around 
research techniques and developmental activities. 

As indicated above the Committee, with the exception of Dr, flays, met 
during July. At that time, several resecirch training proposals were available for 
them to consider. The veiy tight time schedule and the necessity of inalcing 
decisions on those proposals prompted extensive discussion of the purposes of the 
training sessions, the goals vdiich the association hoped v/ould be achieved by the 
sessions end many procedural questions. Dr. Richard Harbeck, U.S. Office of 
Education, met with the group on© morning to answer questions and to provide 
information. Mr. Gary Hanno/of the American Educational Research Association, 
met with the Committee the first evening to share information about his experiences 
with similar training programs sponsored by AERA. 

At the conclusion of the July meeting, each committee member agreed to 
contact one of those whose proposal had been reviewed favorably by the Committee 
or to initiate contact with someone the Committee felt would be appropriate to 
>. conduct a session. Five sessions were developed and, for the most part, the 
Individuals first recommended by the Committee to serve as session directors 
accepted the invitation. 

The session directors were asked to submit a prospectus, outlining the v/ay 
in which they perceived their training sessions being conducted. The statements 
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submiifccl were rc.yiswed wlih Mr. Harbeck in the Research Training Branch and 
wove rei-urfiecl to the dlreciors^^ v.'ii-h comments and suggestions for revisions. A 
more detailed program proposal was submitted by each director in So-ptembsr 
and these pF'oposuls were incorporated into cm APGA Proposal to the U..S. Orficc 
of Education and vras subsequently approved for funding. 



Progrcin'i titles c:nd the nomes of directors of the vivo sessions Ivelcl arc as 
fo!lov/s: 



SESSION 



TITLE 

Computer Technology in 
Guidance 

Systems Reseurch for Counselon 
Counselor-Educcjtors, and 
Suporvisors 

Utilizing Research to Improve 
Counseling Programs 



DIRECTOR 
C.E, Holm 

City University of New Yor 

T. Antionette Ryan 
University of Hawaii 



Gary R. V'/alz 
University of AAichigan 



IV 



Field Oriented Research in 
Ecological Sfudies and Develop- 
ment Models for Counselors^ 
Counselor-Educators, and 
Supeivisors 



Francis A. J . lanni 
Teachers College, 
Columbia University 



V 



Problems of Rt.jearch, Supervision, Chris D. Kehas 

and Consultation Claromont Gradunte School 



Advance c 'rangements v/ere made with the Jung Hotel in New Orleans to 
accommodate the four sessions held in that city. Arrangements for the Chicago 
pre-conference woi’kshop were made with the Pick-Congress Hotel, Chicago, Illinois. 

A two-day meeting of the five session directors. Chairman of the APGA 
Research Training Session Committee and staff of the parent association was held 
at the Jung Hotel on February 19 and 20, 1970, The meeting served, principally, 
as an on-site investigation of facilities, and available equipment and afforded 
the opportunity for directors to exchange ideas on Instructional techniques to 
develop common logistical procedures and a format for reporting and evaluating, 
and to discuss procedures for selecting participants to ensure that all acceptable 
applicants would be accommodated. Tlie fact that one of the session directors 
had had previous experience as director of a training session proved invaluable 
in the resolution of minor problems discussed. 



SELECTION OF APPLICANTS AND PPsOCESSiNG OF- APPLICATIONS 



ParHcipafion in the 1970 APGA Research Training Sessions was not restiTcted 
to assooiatlon members. Although each director indicaled the qualifications he 
would be looking for in applicants for Ills paiiTcuiar session, the only genera! 
requirement was that participants be full or part-time counseloi's, counselor- 
educators or counselor-supervisors. Graduate students enrolled in Insiltuilons of 
highor learning were not considered since the training sessions were designed to 
upgrade the skills of those v/hose formal graduate programs had been completed. 

Applications for the five sessions were mailed to the APGA membership 
as well as to about 250 counselor-educcitoi’s on a special mailing list. Each 
applicant noted a first and second choice of sessions preferred and returned the 
application to the committee chairman, who rocorded receipt of application and 
maliod the form to the fimt choice director. Insofar as possible each applicant 
was admitted to his first choice of sessions. However, in instances where the 
applicant's qualifications did not meet those set by the director, the application 
was forv/ardsd to the director of the applicant's altornate choice. All acceptablo 
applicants v/ere accommodated in one or another of the sessions and were 
notified of acceptance by the director of the session vo which they were admitted, 
together with information concerning location aiid scheduling of program, special 
reading requiremants and fees for ppinted materials, v/here applicable. 



EVALUA Tl ON OF THE TRAINING SESSIONS 

An anonymous evaluation was made by the participants of the various sessions. 
The quesHonnaire used, ■ facsimile of the AERA 1970 Participant Evaluation Form, 
was administered by session director and staff on the last day of the presessions. 

This ivpe of questions included the foIlov.-ing: 

1) The ovorall quality of instruction in your session was: Excellent, 

Good, Average, Fair, Poor 

2) Leaving aside the quality of instruction for the moment, do you think 

the topic treated !n your session should be included in next year's 
Presession Program? Yes No 

3) If you had it to do over again, would you apply for the session which 

you have just completed? Yes No 

4) If this same session is held again, v^ould you recommend that others 

attend? Yes No 



5) How good was Hio scheduling and mononomonl' of the Prosession 

you atf'ond&d? Very good/ ^Good, Poor, 

Very poor 

6) Hov/ good were ihe meeting room facilitios for the presession 

you attended? Very good. Good, Poor, 

Very poor 

7) Do you think you had the appropriato prerequisite-s or prior 
knowledge Jo make v/hat you learned at this Presession of re"" 
search, teaching, or admlnistratis^e value to you? 

More than necessary. Just the right amount, 

“ Not onough 

8) Did the teaching staff make sufflciGnt allowance for the variability 
in prior knov^ledge brought to the Presession by the participants? 

Nearly all the time. Most of the time. Some of 

the time. Hardly ever " 

9) Was there sufflciant time for you to interact with the staff with 

respect to information and knowledga presented in the Presession? 

Yes No 

10) Did the amount of work required by the staff, of the participants, 

seem acceptobls to you? There was: Too much. 

Just bbout right. Too little 

11) Would you like to learn more on the topic you studied here? 

Yes No 

12) Was five days a sufficient time to learn and master the materials 

of your Presession? Yes No 



The Tables reported herein are based only on an analysis of the questionnaire 
administered to program participants of Sessions !*, II* and IV. (The forms were 
not submitted to us by Sessions III and V.) A study of the individual session reports, 
however, reveals a similar pattern of response concerning varying aspects of the 
presessions. 



^ArnKe participants did not complete the questionnaire, 
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In Tnble r, iho porcento^o distribulion of responses to the quosHon relotecl fo 
the overall qua! If)' of instrucMon shows that within three sessions, 97 percent of the 
participants considerod the sessions bohveen ciood and excellent/ v/ilh ilie over- 
vdielmingly larger percentage reporting an excellent rating. The statistics speak 
highly not only of the Committee's choice of directoi'S/ but of the staff which 
directore chose to assist them. 

Tables 11/ III anr' IV which relate to the feasibility of including the ression 
in the 1971 program, whether or not participants v^ould apply for the session 
again and if participants would recommend that others attend, show that participants 
were almost 100 percent in responding affirmntis'ely to the throe questions posed. 
Only in Table III was there a 3 percent "No" response concerning pcirticipants' 
desire to reapply for the same sGssion~“a response which should not be consldored 
negative in any way. 

Such universal agreement suggests that the presession programs were excep- 
tionally beneficial to the participants and that they valued the instruction received 
enough to endorse Its continuance and recommendation to other researchers. 

The majority of Jhe participants found the scheduling and management of 
the presession (TaMe V) acceptable, v.'ith 95 percent rating these aspects good to 
very good. Five percent of the participants felt that scheduling and management 
were poor. Some of the participants (even those who gave the rating good or 
very good) noted that the evening schedules were somewhat tedious and expressed 
the feeling that it would have been more advantageous hod tfe reading mdierials 
been mailed In advanco of- the workshop. 

* According to the statistics in Table VI, 75 percent of the participants found 
meeting room facilities from good to very good and 25 percent felt that the facilities 
were undesirable. The major complaint dealt with the noise factor as a result 
of the closeness of the meeting rooms, and with the numerous changes made in 
room assignments. 

The statisHcs reported in Table VI! show that 61 percent of the participants 
felt they had sufficient prerequisite skills for the training. It is not surprising 
that the highest percentage of the participants who considered their prior know- 
ledge inadequate came from Session I which was involved with Computer Technology 
and that the highest percentage of those who considered themselves as having 
knowledge beyond what was necessary for the session were enrolled in Session IV 
which took the behavioristic approach primarily. 




O 

ERIC 



- 7 - 



TAFM-IH 1 



Tho overall qua'iiy of Insiruclion in your scssi o.n 
was; Excellcni', Good;^ Average, Fair, or Poor 



Response in 
Percent' 


1 


Presession 

2 


Number 

4 


Total Percent 


Excellent 


63 


79 


61 


70 


Good 


37 


21 


28 


27 


Average 


0 


0 


n 


3 


Fair 


0 


0 


0 


0 


Poor 


0 


0 


0 


0 


Total Number 


16 


33 


18 


67 



TABLE 1 1 

Response In 
percent 


Leaving aside the quality of instruction for the moment, 

. .do you think the topic treated In your session should bs 
included in noxt , ear's presession program? Yes or No 

Presession Number 

12 4 Total Percent 


Yes 


100 


100 


100 


100 


No 


0 


0 


0 


0 


Total Number 


16 


33 


18 


67 
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TABLE 111 



Respohsa In 
Percent' 

Yes 

No 

Tofa! Number 



if you had to do it over again, nvouIcI you apply 
for the session which you have just completed? 
Yes or No 

presession Number 



1 2 4 

100 100 .89 

0 0 n 

16 33 ■ 18 



Total Percent 
97 
3 
67 



TABLE IV If this same session Is held again, would you 
recommend that others attend? Yes or No 



Response In 
percent 

Yes 

No 

Total Number 



1 

100 

d 

16 



Presession Number 
2 4 



100 



0 



33 



100 



0 



18 



Total Percent 
I JO 

0 

67 



TABLE' V How good w'as the scheduling and management of 

the Presession you attended? Very good. Good, Poor, 
or Very poor 



Response in ... . .... Presession Number. - 

percent 1 2 4 Total Percent 



Very good 


44 


91 


22 


61 


Good 


56 


9 ' 


61 


34 


Poor 


0 


0 


17 


5 


Very poor 


0 


0 


0 


0 




16 33 

' IS- 



Total Number 



18 



67 



TABLE VI HoVv' good svero vIig rneefinc, room facilities 
for the f’resession you attended? Veiy good, 
Good, Poor, or Vor)' poor 

Response In . Presession Number „ ... 



percent 


1 


2 


4 


Total Perce 1 


Very good 


25 


6 


' 28 


17 


Good 


44 


64 


61 


58 


poor 


19 


18 


11 


16 


V'ery poor 


12 


12 


0 


9 


Total Number 


16 


33 


18 


67 



TABLE VII 


Do you thiriK you had the appropriate prerequisites or 
prior knowledge to make what you learned at this 
Presession of research, teaching, or administrative 
values to you? More than necessary. Just the right 
amount. Not enough 


Response in 
Percent 


1 


presession Nu 
2 


mber 

4 


Total Percer 


More than necessary 


6 


15 


22 


15 


Just the right amount 


50 


64 


67 


61 


Not enough 


44 


21 


11 


24 


Total Number 


16 


33 


18 


67 
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As indicaisd by siaiisflcs in Table VIII iheic was a positive rcsponsa nolecJ by 
pcrf'icipants regarding the ollov/anco sioff made for variabiliiy In t'le prior 
knowledcje participants possessed, Althougb tbs levels of allowance start made 
varied y. none of the participants felt there was a lack of flexibility. This aspect 
ot the program emphasises the ability of instructors to commuiiicate effectively 
to a diversified group of pari icipants. 

Table IX shows the response to the question related to whether the amount 
of v/ork required by staff of the participants was acceptable. Eighteen percent 
of the pat'Hcipanl-s felt that the requirements were unreasonable, again focussing 
on the amount of reading required and the pace of the evening schedule. Ail of 
the responses denoting too little required were given by participants In Session 
IV, This suggests that overall the expectafions staff had as to v^'hat might be 
accompitshed were well thought out. 

The importance of the sessions held and the degree of their value to the 
participants is indicated in Table X, which shov.'s that 100 percent of the 
participanis reported that they desire to learn more on the topic studied in the 
presession attended. 

As reported in Table XI, slightly more than 50 percent of the participants 
viowed five days as sufficient time to learn and master the materia! of the pre- 
session attended. Of the overall 48 percent of respondents answering "No" to 
the question, tlie largest percenfage came from participants Involved in the 
Computer Technology session. 

Many of the participants who answered "No" did not indicate what they 
considered sufficient time for coverage of presession materia! (43 percent) . Among 
those who did give an opinion, 33 percent indicated that they would attend a 
fwo-week presession on the same material as compared to 24 percent who noted 
that they would consider a seven-day prasession sufficient time. 
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TABlLi VIII Did fhe leaching si'off make sufficienf allowance for 
the variability in prior knovdsdge brought to the Pre- 
sessions by the participcinis? Nearly q!l of the time, 
Most of the time/ Some of the lime/ Hardly ever 



Response in . 
percent 


1 


Presession 

2 


Number 

4 


Total Percent 


Nearly all tha time 


50 


40 


'39 


42 


Most of the time 


31 


36 


39 


36 


Some of the time 


19 


24 


22 


22 


Hardly ever 


0 


0 


0 


0 


Total Number 


16 


33 


18 


67 



TABLE (X 


Did the amount of work required by th 
participants/ seem acceptable? Tnere 
Jujt about right/ Too little 


e staff, of the 
was.' Too much/ 


Response in 

Percent 


1 


Presession Number .. .. . 

2 4 


Total percent 


Too much 


6 


33 0 


18 


Just about right 


94 


67 83 


78 


Too little 


0 


0 17 


4 


Total Number 


16 


33 18 


67 
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TABLE X V/ould you like io learn more on the topic you 
stucHod there?' Yes or No 



Response fn 
percent 


1 


Presession 

2 


Number 

4 


Total Percent 


Yes 


100 


100 


100 


100 

• 


No 


0 


0 


0 


0 


Total Number 


16 


30 


18 


67 



TABLE XI 


Was five days a sufficient time to learn 
master the material of your Presession? 


aid 

/es or No 


Response In 
Percent 


1 


Presession Number - 
2 4 


Total percent 


Yes 

) 


44 


55 


56 


52 


No 


56" 


45 


44 


48 


Total Number 


16 


33 


18 


67 




If nO|, would you 
presession on the 
Yes, two weeks 


attend a seven-day or two-week 
same material? No^ Yes, sevc: days; 


Response in 
Percent 


1 


Presession Number 

2 4 


Total Percent 



No 


6 


6 


n 


7 


Yes, 7 days 


19 


27 


22 


24 


Yes 2 weeks 


44 


21 


45 


33 



No response 



31 46 



. 22 



36 




Total Number 16 



18 




67 



33 



The concluding secfion of fliis reporf' conkjins descripiions of iiie five 
Research Training Sessions, v/hich include the foiloNving components; 

1 , Title of Session 

2, Staff 

3, General Description 

4, Purposes and Obieefives 

5, Schedule 

6, Participants 

7, Instructional Materials 

8, Evaluation 

9, Director's Evaluation 

The descriptions are drawn, predominately, from reports submitted by the 
session directors. Minor editing v/as undertaken in order that the reports might 
be presented in as, uniformed a format as possible. 
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RESEARCH TRAINING SESSION DESCRIPTIONS 






O 

ERIC 



PRKSF.SS10N I 



Tiile: COMPUTER TECHNOLOGY IN GUIDANCE 

Staff: 



C. E, Helm 
(Director) 


Tho City University of Nev^^ York 
New York, New York 


David Archibald 


Center for Educational Softv/are Development 
New England School Development Council 


Wailand Bessent 


University of Texas at Austin 
Austin, Texas 


Mrs. Mary Farrell 


The City University ot New York 
New York, New York 


Stanley Fisher 


The City University of Nev/ York 
New York, Nev/ York 


Miss Elaine Klrsh 


The City Univereity of Now York 
New York, New York 


Max V'/einer 


The City University of New York 
New York, New York 


General DescripHon' 




The presession was designed to introduce counselors, counselor-educators, 
and supervisors to fundamental concepts of the science and technology of 
computation, and to educational applications of computer technology which 
have particular relevance to guidance functions. 



The explosive grosvlh of the science and technology of information pro- 
cessing encompassing the field of communication as well os the field of 
computation will have an enormous impact on the processes of education. 

It is of the utmost importance that counselors, counselor-educators, and 
supervisors be thoroughly familiar with these fields because of the key role 
they must play in bringing about vitally needed changes in education, many 
of which'become possible because of modern information technology. 

The underlying theme of the presession was the representation problem; 
that is, what are characteristics of useful modes of representation of edu- 
cational problems and processes that facilitate rigorous analysis and solution. 
The science and technology of computation can provide tremendous power for 
such analysis; however, it Is the educator who must formulate the questions 
in a relevant manner. 
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4, Purposes and Ob]ec!lves; 

Specifica!!y Ihe program v/as designed to achies'-e the following objectives: 

’ 1 . Participants would acquire an understanding at on elementary 

level of basic concepts In the science and technology of computation 

2, Participants would be able to, use these concepts together wlih 
their prior knov/ledge of educational principles and practices 
to acquire an understanding of the design, operation, and 
evaluation of computer-based guidance systems, computer-assisted 
instruction systems, and automatic school scheduling systems. 



5, Schedule; 




Day 1 


Overview and Orientation 
Fundamentals of Computation: 

General Concepts (software and hardware) 
Introduction to the use of programming languages to 
represent problems, discussion of interaction 
between language and data base 
lecture on the BASIC pi-ogramming language 
Lecture on the BASIC programming language (continued) 


Day II 


Overv^iew and Orientation 

Computer Based Guidance; introduction to the 
Information System for Vocational Decisions, 
evaluation of present system 
Script writing 
Special interest seminars: 

1) Computer-based guidance 

2) Management information system 

3) BASIC 

Special interest seminars: 

1) BASIC 

2) SMISR - A Simple Information Storage and Retrieval System 







ERIC 
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Day III 



' Overview and Orieniaiion 

Compuier-Assisled InsirucHon: history and advantages of 
CAI, discussion cind demonstration of classes of 
CAl program 

Demonstration or iNBASKET 
Special interest groups*. 

1} CAl 

2) Computer-Based Guidance 

3) BASIC 

Special Interest groups: 

1) BASIC 

Day IV 

"" ^ Overview and Orientation 

Computer-Based Scheduling: introduction to scheduling 
support systems,, schedule builders 
General applications, scheduling algarithms, educational 
implications of various approaches 
Special interest groups: 

1) Computer-Based Scheduling 

2) BASIC 

3) Computer-Based Guidance 
'i Special Interest group: 

1) BASIC 

* f 

Day V 

” Evaluation of educational programs; problems of researchers 
in school setting 

Discussion of relationship between counselor and computer 
Summary and evaluation of Presession 

Participants: 

Of the twenty-three participants, ten are male and thirteen are female 
Fifteen participants are at the masters level, most of whom have acquired 
credits toward the doctorate; six of the participants have doctoral degrees. 
Ten of the participants are employed as school counselors, seven are in 
supervisory positions and six are employed as trainers of counselors. 

Instructional Materials; 

Advance materials were sent to participants prior to the opening of the 
training program. Included in this package was an extensive bibliography on 
the computer in education. 

The staff of the presession set up a library of 72 volumes and periodicals 



relating to computer technolog/ in guidance. These mateiTcils weio 
available throughout the presession for participants to borrow. 

Evaluation; 

A pfe- and post-test, consisting of 24 questions v/as used in order to 
evaluate the level of familiarized ion that participants achieved in the 
various areas. 

Participants were asked to rank their abilities on a variety of computer 
related tasks on a 1 ~ 5 scale as follows: 

1) 1 could easily do this, 

2) 1 would have some difficuily in doing this. 

3) I would have a great deal of difficulty doing this, but 
could probably gat it done. 

4) 1 could probably not do this, 

5) It would be hopeless for me even to attempt to do this task. 

Pre-test mean "score" was 3.76 (i.e. I could probably not do this). 
Post-test meansscore was 2,03 (i.e. I Vv'ould have some difficulty in doing 
this). This difference is significant siattstically as well as cducatioria! !y . 

The Formative Evaluation Questionnaire was administered twice during the 
presession. Results are presented in Table I. 



Director’s Evaluation; 

I was most favorably Impressed by the enthusiasm of the participants for 
the topic, Computer Technology in Guidance, I was equally impressed by the 
ability of the group and by their progress during the week. They appeared to 
gain considerable insight into the issues involved In applying computer technology 
to proulerns In guidaico, as well as some familiarity with current applications. 

Experience has shown that It is almost Impossible for anyone to acquire an 
operationally useful understanding of the concepts of computer technology with- 
but some experience in computer programming. Accordingly, since the 
participants almost without exception had had no prior programming experience, 
v/e devoted considerable time to programming outside of the seminars. Everyone 
learned BASIC and wrote at least one (usually several) simple programs. The 
short time available made it difficult to integrate this experience with the 
other aspects of the presession, although participants generally felt that programming 



helped clarity olher Issues, 



If was the general consensus that practical training in programming svos 
not readil)' available at their own institutions. 

V'/hile the primary goal of the presession was achieved reasonably, our 
efforts cannot have significant impact on the profession as a whole unless 
the people we train can themselves have some significant Impact, The best 
we can hope for in a 5-day seminar is to get naive participants "turned on" 
about the possibilities of computers in guidance. We must be able to 
provide extensive folIov/'-up support for those counselors vrho are sufficiently 
interested to v/ant to continue. 

Future prosessions should Include a repeat of this genera! introducHon with 
a greater emphasis on programming, as v/all as presessions on advanced topics 
designed for persons with sufficient background to deal in depth with specific 
computer app Meat Ions In guidance. 



24 




- 19 - 



TABLE ( 



Formafive Evaluojion Quesi lonnairo Resuii’s 

Key: SA (Sfrongly Agree), A (Agree), (Undecided), D (Disagree, 

SD (Sirongly Disagree), NA (No Answer) Please circle your choices. 



Second Day Fiflii Day 





SA 


A 


9 


D 


,SD 


NA 


SA 


A 


9 


D 


SD 


N/ 


1 . The objecHves of fhis 
program were clear io me. 


4 


14 


1 


1 


0 


0 


6 


13 


1 


0 


0 


0 


2. The objectives of this 
program v/ere not realistic. 


0 


0 


6 


10 


4 


0 


0 


2 


3 


8 


7 


0 


3. The participants accepted 
the purposes of this program 


3 


13 


2 


1 


0 


1 


6 


13 


0 


0 


0 


1 


4. The objectives of this pro- 
gram were not the same as 
my bjectives. 


0 


0 


2 


12 


6 


0 


0 


3 


4 


6 


6 


1 


5. I have not learned much new 0 


1 


1 


10 


8 


0 


0 


0 


0 


7 


13 


0 


6. The material presented 
seemed valuable to me. 


7 


11 


2 


0 


0 


0 


11 


8 


1 


0 


0 


0 


7, 1 could have learned as 
much by reading a book. 


0 


3 


1 


8 


8 


0 


0 


1 


0 


8 


11 


0 


8, Possible solutions to my pro- 
blems are not being considerQd.O 


1 


3 


8 


6 


2 


0 


1 


2 


8 


8 


1 


9, The information presented 
was too elementary 


0 


0 


1 


7 


12 


0 


0 


0 


1 


7 


12 


0 


10, The speakere really know 
their subjects. 


6 


14 


0 


0 


0 


0 


10 


10 


0 


0 


0 


0 


11 , ! was stimulated to think 

about the topics presented. 


6 


14 


0 


0 


0 


0 


8 


12 


0 


0 


0 


0 


2. We worked together as 
well as a group. 


1 


9 


4 


4 


0 


2 


6 


12 


1 


0 


0 


1 
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Key: SA (Strongly Agree), A (Agree), ? (Undecided), D (Disagree), 

SD (Strongly Disagree), NA (No Answer) Please circle your choices. 



Second Day . Fifth Day 



13, The group discussions were 
excellent. 


SA 

0 


A 

5 


o 

3 


D 

3 


SD 

0 


NA 

9 


SA' 

6 


A 

7 


? 

5 


D 

1 

1 


SD 

0 


NA 

1 


14. There v.'as little time for 
informal conversation. 


1 


2 


1 


10 


4 


2 


0 


1 


0 


8 


11 


0 


15. 1 had no opportunity to 

express my idecis. 


0 


2 


1 


11 


5 


1 


0 


0 


0 


8 


12 


0 


16, 1 really felt a part of 
this group. 


0 


12 


2 


2 


2 


4 


4 


14 


1 


0 


0 


1 


17, My time was v/ell 
spent. 


3 


14 


2 


1 


0 


0 


9 


10 


1 


0 


0 


0 


18. The program met my 
expectations. 


2' 


5 


10 


2 


0 


1 


6 


7 


4 


3 


0 


0 


19. Too much time was 

devoted to trivial matters. 


0 


1 


3 


8 


6 


2 


0 


1 


0 


11 


7 


1 


20,. The information presented 
was to advanced. 


0 


0 


9 


8 


3 


0 


0 


0 


0 


12 


9 


0 


21 . The content was not 

readily applicable to much 
research in education. 


0 


0 


6 


10 


4 


0 


0 


0 


0 


, 8 


11 


1 


22, The Assistant was very 
helpful. 


2 


14 


3 


0 


0 


1 


11 


9 


0 


0 


0 


0 


23. Theory was not related to 
practice. 


0 


1 


3 


12 


3 


1 


0 


0 


0 


14 


6 


0 


24, The schedule should have 
been more flexible. 


0 


2 


5 


10 


1 


2 


1 


1 


0 


14 


4 


0 
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■ pR£SE$.sion II 

1. Title: SYSTEMS RESEARCH FOR COUNSELORS, COUNSELOR“EDU“ 

CATORS, AND SUPERVISORS 

2, Staffj 

T. A. Ryan 
(Director) 

Donald G , Hays 

Ray E . Hosford 

James W. Lawrence 

Leonard C. Silvern 

Norman R. Stewart 

Bob W inborn 



3, Genera! Descripfion: 

The program was designed to provide a carefully soquenced series of 
exercises and problems integrated with didactic instruction. Itwasassumed 
that factors influencing extent to which program aims could be achieved 
included participant background, staff competency, quality and quantity of 
information presented and practice provided. 

Participants were selected who met cr'ireria for education and experience 
deemed essential for progress in the course. In staff selection the intent was 
to combine competencies of different instructors into a strong instructional 
team capable of didactic presentation and supervision over problem-solving 
activities. 

The amount arid kind of information presented was controHed through the 
planned reference list and directed reading, including pre-conference 

preparation. , „ 

■ 




Univereity of Hav/aii 
Honolulu, Hawaii 

Funerton Union High School District 
Fullerton, California 

University of California 
Santa Barbara, California 

University of Hawaii 
Honolulu, Hawaii 

Education and Training Consultants, Co. 
Los Angeles, Califoiiia 

Michigan State University 
Bast Lansing, Michigan 

Michigan State University 
East Lansing, Michigan 
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Purposes and Objectives; 



The ultimata purpose of the presession in systems research was to improve 
counseling;^ counselor“education, supeivision and related areas through research. 
The immediate program purpose was to train selected participants in use of 
systems research principles and techniques for planning and evaluating 
counseling; counselor-aducatiori; supervision and related areas. The program 
purpose was implemented in two primary aims: 

1 . to develop participants' knowledge and undemtanding of systems 

research concepts and principles as revealed by meaningful definition 
of analysis, synthesis, simulation; mo ielling, feedback, and 
behavioral objectives. 

2, to develop participants' proficiency in using systems techniques 
for planning and evaluating counseling and counselor education, 
as revealed by design of c closed loop system with element 
identification, feedback, logical sequence, and part-whole 
relationships and correct use of signal paths, arrowhead formation, 
rectangular blocks, descriptors, point numeric codes, F, FF, A, 
and error signals. 

Schedule: 

The training program designed to achieve presession objectives was five 
days in duration, with daily sessions-from 8:00 a.m. to 12:00 Noon, and 
1:00 p.m. to 4:30 p.m. Evening sessions were not scheduled os a required part 
of the program. The training facilities were open from 7:00 to 10:00 each 
evening, with instructors on hand to work with individual trainees or groups 
of participants, A demonstration of computer simulation and presentation of 
mathematical modelling were given during the everjing hours. 

The presession opened with an orientation to the training program. This was 
followed immediately by a pre-test to determine extent to which poiticipants 
already were capable of demonstrating the terminal behaviors defined in the 
program objectives. There were seven major elements In the program, following 
completion of the pre-test; (1) instruction in basic concepts and principles 
to reinforce required pre-conference reading; (2) basic instruction in skill 
development; (3) advanced instruction in concepts and techniques; (4) practice 
in applying systems skills and techniques; (5) post-test to determine extent 
to where participanls had progressed toward criterion performance; 

(6) application of concepts and techniques in developing a solution to a 
real-life problem; and (7) presentation of models demonstroting systems 
research in counseling and counselor-education. 



The learning activities implemented to achieve Ob|ec,ivG 1, developing 
participants' understanding of systems concepts and principles, included 
assigned reading, lecturer, slide-tape presentations, films, individualized 
activities with programmed material, and supervised practice on workbook 
exercises. 

Activities to achieve Objective 2, developing participants' proficiency 
in using systems techniques and skills Included film-tape presentation, and 
supervised practice on individual and group problems, including work on 
analysis, synthesis, and flow chart modcdllng. Advanced exercises and 
extra assignments v/ere utilized to help meet individual needs. 



Day I 

Pre-Assessment 
Introductions 

Program Ov ervlsw: Purposes, Objectives 
Procedures 

Defining Goals and Objectives 
Modal for Producing a System (use of slide tape) 
LOGOS Language for Flow chart (use of slide tape and 
Individualized Activity) 

Systems Engineering of Learning (use of filmstrip tape) 
^uestion-and-AnswQ- Perior 
Analysis as a Process (Individualized Activity) 

Systems Using (us© of slide tape) 

Discussion 

AnnouncemenJs and Assignments; Problems 



Evaluate Solutions to Problem 1 
Synthesis as a Process (use of slide tape) 

Systems Including Synthesis and CAI 
Problem 2 (Individualized Activity) 

Evaluate Solutions to Problem 2 

Model for producing a System Model (use of slide tape) 
Study Closed Loop Instructional Flow chart 

Model; Boeing ‘ 

Problem 3 (Individualized Activity) 

Afternoon; Evaluate Solutions to Problem 3 
Problem 4 Satellite 
Evaluate Problems Solutions 
Announcements and Assignments Problem 5 



Morning; 



Afternoon: 



Day II 

Morning; 



Day 111 



Morning; Evafuale Problem Solutions - Problem 5 

Study Complex, Closed Loop Instrucfiotial 

Flow chart Mode!: Occupational Instruction 
and Government Basse! Information 
problem 6 

Evaluation of Problem Solutions 



Afternoon: Problem 7 

Announcements and Assignments 



Day IV 

Morning: Evaluate Solutions to Problem 7 

Pos t“ Assess me n 1' 

Real-life Ptoblem '' 

Afternoon; Real-life Problem 

Announcements and Assignments 



Morning; 'Evaluate Solutions to Real-life problems 
program Evaluation , 

A Counseling Mode! 

Afternoon: Model for a District Testing Program 

Review and Preview: Systems Approach-Implications 
for Counseling, Guidance, Counselor-Education 
and Supervision 

6, Participants: 

Forty-five participants were selected from sixty-three applicants for the 
presession. Attrition of five left forty in attendance during the training 
program. Participant characteristics are given below* 
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Highest Educational Degree Attained 




Sex Number 




Degree 


Number 


Male -27 




Bachelors degree 


2 




Female 13 




Masters degree 


10 








Doctoral candidate 


3 




N= 40 




Doctoral degree 


25 










z 

11 

o 




place of Resfdenca 




Nature and Place o 


if Employment 




Region State 


Number 


Employer 


position 


Number 


South 




University or College 




Florida 


1 




Dean 


1 


Alabama 


1 




Assistant Dean 


1 


Mississippi 


1 




Chairman 


4 


South Carolina 


2 . 




Director 


1 


Georgia 


1 




Professor 


9 




“~6 




Assoc, Professor 4 








Asst, Professor 


9 


Southwest 






Coordinator 


1 


Arkansas 


2 




Instructor 


1 


Louisiana 


4 




Res, Associate 


1 


Oklahoma 


1 




Counselor 


2 


T^xas 


9 






34 




16 












Local School 






East New Jersey 


1 




Counselor 


2 


Nev/ York 


2 




Asst. Director 


1 


Maryland 


3 






3 


Kentucky 


, 1 








Massachusetls 


1 


Agency, Military 








8 




Counselor 


2 








Director 


1 


Midwest 








~ 3 


Missouri 


1 








Ohio 


1 






z 

11 

O 


Michigan 


2 








Nebraska 


1 








Indiana 










Illinois 


1 










_ g 










Washington 

California 



1 

1 

- 2 

N = W 
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InsirucHonal Maierials: 

Prior to the start of the presossion, enrol iees were sent a rnaterials 
packet, with directions for pre-conference reading, seven reference 
materials, syllabus and staff directory. 

Evaluation: 

Two measures were taken to evaluate participant performance against 
program objectives: an objective pre- posttest and subjective participant 
self-evaluation. Evaluation of the research training session was accomplished 
by compai'ing pre- and posttest group profiles and by comparing pre- and post- 
test scores against criterion standards for acceptable performance. The pre- 
posttest was designed to sample behaviors defined by Aims 1 and 2, developing 
underetanding of concepts and principles of systems research and developing 
pioficiency In using systems techniques. The pre- posttest instrument con- 
sisted of three subtests, two of which sampled behaviors of concept under- 
standing, and one sampled profIciency«in using systems techniques. 

Table 1 shows the group profile for median scores on the pre- and posttest 
by program objectives. Inspection of Table 1 reveals that the posttest median 
scores for undaretanding of concepts exclusive of behavioral obiectives were 
four and a half tiroes larger than the pretsst median score. The median score 
for the understanding of behavioral objectives was double the pretest score. 

The- posttest score on the test of skill proficiency was three times the pretest 
score. When the pre- and posttest scores were compared against criterion 
standards for acceptable performance (Table 2), it was found that over three- 
fourths of the participants developed understanding of concepts excluding 
behavioral goals at critarion level on the posttest, with ninety parccnt reaching 
criterion level on the posttest for skill performance. 

Self-evaluation against Aims 1 and 2 were taken by eliciting from participants 
responses to indicate their feelings about their progress to the training ob|ectlves. 
Table S reports results of participants' self-evaluations. Inspection of Table 3 
reveals that 100 percent of participants felt they had developed a significant 
understanding of systems concepts, with 97 percent reporting they felt they had 
acquired proficiency in using systems techniques. 

A program evaluation was made to assess program management, by gathering 
data on learning activities, instructional matericls, program content, and 
program organization. 

Participants rated learning activities on a four-point scale, indicating 
degree to which the activity contributed to achievement of program goals. Mean 
ratings are reported in Table 4. Examination of data reported in Table 4 
reveals all of activities were rated above the chance mean. The learning 
activities rated as most worthwhile in helping participants reach program goals 
were problem solving tasks, assigned readings, and conferences with staff. 



Table 1 



Comparison of Group Profiles of Median 
Scores for Pre- and PosH-est by Program Ob|ective 



Program Objective , ■ 


Median 

Pretesl 


Score 
Post test 


Developing understanding of systems concepts 
exclusive of behavioral objectives 


9.0 


40.0 


Developing understanding of behavioral 
objectives 


3.0 


7.5 


Developing proficiency In using systems 
techniques 


7.5 


22.0 



N= 33 N= 28 



Table 2 

performance Criterion Levels for Trainirig Objectives 
and Percent^of Participants Achieving Criterion Levels 



Objectives 


PossibI 

Score 


Criterion Levels 
e Criterion 

Level 


of Acceptable Performance 
% Achieving 
Criterion Level 
Pretest Posttest 


Understonding concepi? exclusive 
of behavioral objectives 96 


36 


0 


78 


Understanding behavioral 
objectives 


17 


8 


20 


50 


Acquiring pi'oficiency in using 
systems techniques 


40 


20 


17 


90 




33 



I 
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Table 3 



ParficipanI' Self EvaluaHon on Levels of 
Performance for Prorjram Objectives 



— — ~ ^ 'percent of Respondents 

. Reaching Four Levels of Performance 
Program Objectives Groat 

None Little Some Amount 



1 . Amount of new knowledge about 
system research acquired during 

prescssion. 0 0 72 28 

2 , Extent of proficiency in using 
systems techniques developed 

during presession. 0 3 79 18 



Table 4 

Moor/ Rating of Training Program Learning 
Activities 



Learning Activity 



Individual staff conference 
Individual problem 
Assigned reading 



Lectures 





Audio-visual presentations 
Programmed instruction 
General discussion 
Task group activities 
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Mean Rating 
(Md « 3,391/2 

3.69 

3.55 

3.52 

3.42 

3.37 

3.27 

3.14 

3,06 



Table 5 



Mean Ratings of Instructional Materials 



instructional Material 


Mean Rating 
(Md ~ 3.45) 


Ryan, T. A. Systems Techniques for programs 
of counseTTng”anH"*couKsQToF^e31jca7Ton7~ 


3.69 


Mager, R. F. Preparing instructionaT 
obiectiveg. 


3.68 


Silvern, L.C. LOGOS* A system language 
for flowclwt model ing. 


3.52 


Silvern, L, C. Systems engineering of education 




h The evolution of systems tfiinKing in 
education , 


3.38 


Banathy, B, Instructional systems. 


3,30 


Churchman, C, ,W. The systems approach. 


2.96 



35 
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Evaluafion of Insfrucfiona! moferials was made b/ parHclpanf roHng on 
a four-poinl' seals of six rVfercncos wKTch v/ere required readir)g for the 
course. Mean ratings are roporied in Table 5. Inspection of Table 5 reveals 
that all references v/ere rated above the chance mean. The references rated 
as most valuable were Systems techniques for progi-g ms of counseling and 
counselor ec'ucatlon byTT 'a", Ryan,'^n3 Preparing i nstr u ct i on o T dsfecti ves 
by Mag&Vf wTtb the next highest rated references Being LOGOS: A 
system language for flowchart modeling. by Silvern. 

program content was evaluated by participant rot' g on a four-point scale 
of each prograrr unit in terms of contribution, to program goals. Mean ratings 
are reported In Table 6. Inspection of Table 6 reveals fhar units considered 
most valuable were conceptualization of system in model form and con- 
ceptual analysis and synthesis. All units were rated above the chance mean. 

Program management was evaluated by participant rating of aspects of 
program organ izoTi on and management, including program information, meals 
and lodging, staff qualifications, time utilization, climate for learning, and 
physical facilities. Participants ratings of program management indicate 
some dissatisfaction with the program information, meals and living arrange- 
ments, time allocation, and physical arrangements. There was 100 percent 
satisfaction with the program as a whole, as indicated by response to the 
questions concerning scheduling of a similar presession next year. 



Mean Ratings of Program Topics 



Program Topic 


Mean Rating 
(Md = 3.49 1/2 


Conceptualization of system in model form 


3.72 


Conceptualization analysis and synthesis 


3.72 


Model for producing a systems model 


3.62 


Problem; Fn i Real Life Environment 


3.61 


Systems using feedback 


3.55 


Problem; Counselor Education 


3.51 


Rules and Symbols for flowchart modeling 


3.48 


illustrations of Systems Research 


3,32 


Closed Loop instructional system 


3,26 


Problem: Guidance Management , 


3.07 


Problem- Satellite Communication 


2.82 


Problem: LOGOS 


2.77 



V 

37 
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Director’s Evaluation: 



Analysis of results from criterion tests indicates that the aim of developing 
participants' knowledge and understanding of systems concepts and principles 
was achieved by over three-fourths of the participants, with ninety percent 
of participants reaching criterion level in use of systems techniques. Analysis 
of test data revealed that twenty percent of participants started at criterion 
level on understanding of behavioral ob]ectives. At the end of the training 
program, fifty percent had reached performance standards on defining be- 
havioral objectives. The data reveal that none of the participants was 
at criterion level on understanding of other systems c nicepts at the start 
of the program. Seventy-eight percent reached criterion level at the end 
of the presession. The difference between the development of participants' 
understanding of behavioral objectives and their understanding of other 
systems concepts is explained by the nature of the program. The program 
design assumed a prior understanding of behavioral objectives and the learning 
activities were not planned to emphasize understanding of behavioral 
objectives. The indication that twenty percent of the participants had an 
understanding of beliaviora! objectives of the beginning of the program 
indicates the extent to v/hich pre-conference reading on behavioral goals 
was effective. A parallel can be shown with developing participant skill 
proficiency in using systems techniques. On the pretest seventeen percent 
of parti ci pants met criterion levels of use of systems techniques. This 
suggests that one-fifth of porticipanls managed to learn from the basic system 
skills from the pra-conference preparation. However, in looking at the 
participant, understanding of systems concepts, with none of the participants 
meeting criterion levels on the pretest, it seems that the learning of systems 
skills through pre— conference directed reading failed to develop an understanding 
of systems principles and concepts, Tho continued independent use of systems 
research for improvement and innovation of counseling, cqunselor education, 
and related areas requires more than rote skill. There must be understanding 
of assumptions underlying use of the systems techniques, to permit the researcher 
to know how and when to use systems techniques and to be able to Interpret 
results of systems analysis and synthesis. Results of the pre-posttests suggest 
that an important outcome of the training session was the development of 
participant understanding of concepts and principles of systems research, 
along with developing proficiency in using systems techniques. 

The evaluation of program management reflects that organization and 
administration were generally satisfactory, despite difficulties encounterea as 
a result of the very late funding of the proposal and concomitant delays in 
announcing the program. The dissatisfaction with the time available for the 
presession can be taken as a positive endoreement of the program, rather than 
a criticism. The essence of the responses indicating dissatisfaction with 
amount of time for the presession has the effect of saying more time is desired 
to devote to the topic , 
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The dissatisfacfion wiHi physical fact! Hies reflech in pari' the problems 
encountered, not only in the hotel facilities but also in the moving from 
one location to cinolher In the course of the program. 

Participan’ evaluation of instructional materials, techniques and staff 
reveal general satisfaction with these components of the program. There 
was overwhelming endorsement of the program, as indicated by one 
hundred percent response to the question, "Did the program meet your 
expectations?" 

The data from participant and program ovdluation suggest the ■'o re- 
search training programs conducted in cooperation with the annuai meeting 
of American Personnel and Guidance Association meet a very real need. 
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PRESESSION III 



1. Title: UTILIZING RESEARCH TO IMPROVE COUNSELING PROGRAMS 

2 , Staff: 



Gory Walz 
(Director) 


University of Michigan 
Ann Arbor, Michigan 


Ralph Banfield 


University of Michigan 
Ann .Arbor, Michigan 


Donald Blocher 


University of Minnesota 
Minneapolis, Minnesota 


Jean Marie Furniss 


Eastern Michigan University 
Ypsilanti, Michigan 


Don Harrison 


University of Michigan 
Ann Arbor, Michigan 


JohnrHechlik 


Eastern Michigan University 
Ypsilanti, Michigan 


Ronald Lippitt 


University of Michigan 
Ann Arbor, Michigan 


Julie Miller 


University of Michigan 
Ann Arbor, Michigan 


Marlene B. Pringle , 


Eastern Michigan University 
Ypsilanti, Michigan 



3. General Description: 

The workshop was designed to help counselors develop competencies which 
would enable them to effectively adapt counseling procedures to the needs of 
particular student groups and to evaluate the effectiveness of these new pro- 
cedures. The principal emphasis of the workshop was centered around helping 
counselors translate their problems of research Into researchable problems and 
procedures in order to be able to utilize findings from their own research and 
existing research information in the improvement of their 'unctions as counselors 
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Purposes and ObJecMves; 

Specifically, the program was designed to enhance (earning whereby; 

"Participants would develop skills in the process of translating 
specific probleTis which they encounter In their work with students 
into research problems and procedures. 

Participants would develop skills in formulating functional school 
research strategies such as empirical case studies and experimental 
longfltudinal studies. 

Participanis v/ould be introduced to and become competent in the 
use of the ERIC national information system. 

Participants would develop a design for the operation of a local 
micro-information system to facilitate effective research and program 
decision-making. 

Participants would be introduced to the idea that existing research 
information (as well as self-generafed research information) could 
suggest new counseling practices and would develop skills which 
enable them to utilize existing research information more effectively. 

Schedule: 

} 

■ f 

Day I 

Orientation 

Data Collection on Participants 
Conceptualizing Problems in Researchabie Terms 
participant Development of Individual Research Problems 
Review of Problem Statements 

What Our Present Research Tells Us About Counseling Procedures 

Day II 

Orientation to Knov/ledge Utilization process 
Understanding Research Generalizations (Laboratory Experience) 
Derisdng Counseling Procedures from Research Generalizations 
(Task Forces on Specific Counseling Areos) 

Review of Knowledge Utilization Process and Sharing of Task Force 
Reporls 

Presentation and Discussion on Topics selected by group 




The ERIC System (Audio Visual Presentation) 

Using the ERIC System (Instruction in the use of ERIC using 
specially prepared materiols) 

Search of ERIC System (Laboratory Experience In which participant 
searches for Information relevant to his research problem) 
Developing Micro-Information Systems 
Guidance Program Innovations 

Day IV 

Finalizotion of Participant Research Problems 
Possible Research Designs- The Empirical Case Study and 
the Experimental Longitudinal Study 
Designing Research Procedures 
Sharing of Designs and Design Problems 

Banquet and presentation on the Counselor as an Action Researcher 

Day V 

Strategies for Implementation of Reseai'ch Designs 

Strategies for Initiating New Counseling Procedures 

Finalization of Written Resoarch Plans 

Workshop Evaluation 

Follow-up Plans and Workshop Closing 



6. Participants’ " 

There were a total of 27 participants involved in the five-day presession, 
A breakdown of participant characteristics follows: 



Sex Number 

Male 12 

Female 15 

N -27 



Flighast Degree Obtained 



Baccalaureate 1 

Masters 14 

Doctoral candidate 1 
Docrorate .1 1 



N - 27 

Nature of Employment 



Higher Education 
Lpcal Schools 
Agency 



19 

.7 .. 

1 
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place of Residence 



Region Sfaf'e Number 



East 


Massachusetts 


1 






New York 


3 






Pennsylvania 


2 










6 


Midwest 


Illinois 


1 






Minnesota 


1 






Missouri 


2 






Ohio 


1 










”"5 


South 


Alabama 


2 






Arkansas 


{ 






Florida 


1 






Louisiana 


3 






Mississippi 


1 






North Carolina 


1 






Tennessee 


1 






Texas 


3 






Virginia 












15 


West 


Colorado 


1 





1 

27 



7. Instructional Materials: 

The- workshop utilized E RIC materials. Including ERIC indexes, the 
Thesaurus, of ERIC Descriptors, ERIC microfiche and selected products from 
' ERIC clearinghouses. 

8. Evaluation: 



O 
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The participants indicated their satisfaction v/ith the v/orkshop in their 
responses to the questionnaire prepared by the workshop staff. The following 
points were mentioned often as reasons for the high degree of participant 
satisfaction; 



1 . 



The focus of the workshop was on each individual's research needs 
in his home area. Most participants indicated they were returning 
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home wilh some practical new research skills that they could 
directly apply in their work settings, 

2, The format Involved a wide variety of types of participant and 
staff interaction which seemed to help keep members involved in 

the workshop process . Lecture presentations, large group interaction 
small group interaction, triad tasks, and staff consultation with 
Individuals were all incorporated as part of the design. At critical 
points in the v/orkshop process, participants indicated they 
benefited considerably from the time set aside for individual 
synthesis of preceding inputs, 

3. The participants Indicated they were exposed to some grorp problem- 
solving strategies that were new and pertinent to them, and many 
participants specifically indicated they could Incorporate th®e 
strategies usefully in their work areas.' 

4, Many of the participants had been only slightly familiar with the ERIC 
system before the workshop and indicated they would utilize Its 
resources in the future. 

5. Partlcinants were especially pleased with the high ratio of staff to 
participants. 

Listed below are the planned-for participant outcomes which were successfully 
implemented by the workshop: 

1 , Development of a Research Design: 

A major workshop goal was for each participant to develop a 
solid feasible research design in an area of particular concern 
to him in his home v.'ork setting. All participants accomplished this 
task. 

. 2. Familiarization with Specific Research Strategies- 

Participants were exposed to research strategies. In particular 
to the empirical case study and the experimental longitudinal 
study, and to develop the appropriate strategy for their own 
particular research interests, 

3, Generation of New Counseling Procedures: 

Participants worked with a specific sat of research generalizations 
and went through the process of beginning to develop a set of new 
counseling procedures based on the generalizations. 
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4. Development of Action Strategies In Utilizing Counseling Research: 

Participants learned through their cvm participation how to 
effcctis'ely use group problom-solving strategies such as force-field- 
analysis/ brainstorming/ and flshbowllng, 

5. Competency Development In the Use of Information Systems: 

Pcn'Mclpants were Introduced to the ERIC nationol information system 
and learnsd how to make the best use of ERIC and similar systems in 
their home areas. As part of.tbo vvorl-cshop program/ participants used 
the ERIC Indexes/ the Thesaurus of ERIC Descriptors/ ERiC microfiche, 
und ERIC publications to search the available research information on 
their individual research topics. 

Director's Evaluation: 

The program so well received by participants on the basis of achieved 
outcomes and participant evaluations/ must be considered a successful effort. 
Staff of the presession and I offer the following recommendations for future 
sessions- 

1 . Assessment of participants' expectations for workshop should be 
made at registration. 

2, Participants should have greater input prior to the workshop as 
to the format and content they can expect. 

3., Some assessment of res'^arch backgrounds and experience of the 
participants prior to th > workshop might be helpfuf for design 
purposes. Maybe there could be a greater flexibility of design 
to meet more individua! needs in a diverse participant population. 

4. Participants indicated that "hand-outs" of condensed lectures by 
speakers would be helpful to take home. 

5. A few participants tended to complain of "lock of structure." 

Written "expectation statements" for participants would fill 
the need for more structure in future workshops, 

6. Workshop physical facilities should be more comfortable in terms 
of size and hearing. 



7 . 



Many participants indicated they were becoming fatigued by 
the end of the workshop, so in the future the design should 
possibly be one day shorter. 

8, The fact that there was a large enough staff to provide a great 
deal of individual attention increased the gensral workshop 
success, according to many par' ci pants. An adequate size 
staff appears to be a good workshop strategy in the future. 



. 
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PRESESSION IV 

1. Title: FIELD ORIENTED RESEARCH IN ECOLOGICAL STUDIES AND 

DEVELOPMENTAL MODELS FOR COUNSELORS, COUNSELOR- 
EDUCATORS AND SUPERVISORS 

2, Staff: 

Francis A. J. lanni , Teachers College, Columbia University 



(Director) 


Nesv York, New York 




Julio George 


Teachers College, Columbia 
New York, Nev/ York 


Uni vers I ly 


David Johnson 


Teachers College, Columbia 
New York, Nev/ York 


Univei^ity 


Barbara McNeill 


Teachers College, Columbia 
New York, New York 


University 


Thomas Niland 


Teachers College, Columbia 
New York, New York 


University 


Joseph Schaeffer 


Bronx State Hospital 






Bronx, New York 




Edward Storey 


Southeastern Education Laboratory 




Atlanta, Georgia 





S. General Description: 

The purpose of the presesion on field research in ecological studies and 
developmenfal models was to achieve improvep Rnt in counseling and counselor- 
education by training counselors, counselor-educators, and supervisors in 
the use and interpretation of field oriented research techniques. 

Recently there has been a growing interest in field studies in the behavioral 
sciences. More accurately, this represents a rebirth of concern, since field- 
oriented research has a respectable antiquity in tho social sciences. Part of 
this new interest results from the felt need to illuminate and extend laboratory 
or clinical data by observing its operation in a real setting. Of equal im- 
portance, however, is the growing conviction that given an appropriate 
conceptual framework and a carefully developed set of tochniqucs, it is 
Indeed possible to approach field studies with the same rigor as laboratory 
research. That is to say, field research can be Just as empirical, just as 
■ experienced, just as practiced, just as inductive as any other s^tem of 
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engagement wi Hi observgble facts, provided that the research is properly 
conceptualized and methodologlcail/ defined. In fact, fleld-oriented 
reseorch has numerous and obvious advantages over the classical experi- 
mental method. For example, in the current educational milieu, In which 
the community Is becoming increasingly ill at case about experimentation 
and testing, it is emerging as the preferred — and in many urban situations 
the only — avenue for entry into the real world of education. 

For the past five years two independent but closely associated groups 
of behavioral scientists at the Medical School of the University of California 
and at the Horace Mann-Lincoln Insiitute at. Teachers College, Columbia 
Uni versity, have been developing incraasingly precise methods of observing, 
recording, classifying, and analyzing field data, "^he one-week v/orkshop 
was an attempt to build on the experience of tliese iwo groups as v/ell as 
others in the field. 

Purposes and Objectives: 

Specifically the program sought to assist counselors, counselor-ea'ucators, 
and supervisors to define field systems for research, to establish parameters, 
and to understand methods and techniques for observing and recording be- 
havior in the field,, 

The participants were able to: 

1 * Desrelop an undersi’andmg of the relationship among exparimental, 
survey f c!lnical and field research techniques and their application 
in tha area of ecological studies and davelopmental raodcis 
specifically and in the area of counseling in general, 

2m State and apply tha protocols of research techniques dealing v/Ith 
(a) observation, (b) recording, (c) classification, (d) analysis, and 
(e) interpretations of field research data and their relationship to 
data gathered from other forms of research, 

3^ Demonstrate the use of these techniques through Involvement in a 
number of model and actual field research problems which were 
established as part of the training program. 

4., Gain experience through preliminary training in the use of field 

research techniques such as observation and recording of data, the 
use of various electronic devices in recording field information, and 
techniques of analysis of data gathered in the field. 



Content areas included; 



1. Historical and theoretical implications of working in field situations in 
which behavior can be observed and collected, 

2. Implications of ecological patterning and c ovelopmenta! sequencing 
as they occur in "real" as contrasled to experimental or clinical 
systems. 

3. Definition of field systems for research purposes and establishing 
behavioral parameters. 

4. Method and technique in observing aiid recording behavior in the 
field, participant and non-participant observation, and the use of 
electronic collection systems, 

5. Classifying data derived from the field and preliminary taxonomies. 

6. S>'$tems of analysis for field data and their use in various types of 
field research. 

7. Deriving theory from field-oriented researcli. The princlpa! emphasis 
here v/as on the "groui'idod theory" approach developed at the Uni- 
versity of California and the situational analysis" system develcped 
at Columbia, but other schemes were included. 

8. New directions and problem areas in ecological studies and develop- 
mental models. 



5, Schedule: 



V 



Day 1 



Morning: 



Afternoon; 



Discussion of workshop objectives, activities, participant 
requirements 
Distribution of materials 

Film-pretest exercise in observation and recording data 

Field-oriented research education - historical and 
theoretical implication 
Discussion 

Fcological patterning and developmental sequencing 
(compared with experimental and clinical systems) 
Elements of systems analysis 



Discussion 
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fv jrning; 


Evaluation of models 

Use of electronic collection systems 

Introd-jct'on to video taping 


Affernoon: 


Illustrations of the use of video taping in fleld-orionted 
research 

participant practice in the use of electronic collection 
systems 

Coding systems 

Systems of data classification 

Discussion 



Da/ III 



Morning: 


Defining field systems and establishing behavioral 
parameters 
Discussion 

Practice: classification of data from presented case study 


Afternoon: 


Further discussion of "grounded theory" and "situational 
ona lysis" 

Theory generation from field-orionted research 
Discussion 


Day IV 




Morning: 


Field evaluation of administrative structures 
Illustrations and discussion 

participant consultation with staff concerning their 
individual research proiects or interests 


Afternoon- 


Participant-staff consultation (continiied) 

Developmental models for counselors, counselor-educators, 
and supervisors - The use of field-oriented research as 
the springboard to switch from "research for verification 
of theory" to "research for generation of theory" 



Da/ V 



Morning: 


Developmental models (continued) , 

Discussion 


Afternoon: 


Summary and evaluation 
Participants' anonymous evaluations 



6. Parficipanis: 

Of Hie jwenty-seven applicants accepted for the presession, eighteen were 
able to attend for the full five days - eight males and ten females. Twenty- 
eight percent ware counselor-educators, forty-four percent elementary or 
secondary school counselors, and the additional twenty-eight percent were 
counselor supervisors or directors of pupil personnel services. 

Information on participant oducational background indicated that twenty- 
eight percent held o doctoral degree, with the remaining seventy-two 
percent holding at leasi a masters degree (six at the doetDra! di''5ertation 
stage) . 



7. Instructional Materials: 

A two-hundred page handbook of selected readings on field oriented re- 
search was compiled and distributed to each pc* iicipant. Lecturers presented 
a list of reference materials concerning their topics, 

• Five thousand dollars worth of electronic collection systems equipment 
was made availr ble for illustrations and participant use. 

Two films were used for participant practice in observatic and data 
recording. 



8. Evaluation: 

At the completion of the workshop eighteen participants completed an 
anonymous evaluation form vrhich was returned directly to the aPGA Pre- 
session Committee. A report of the responses is given in an earlier seevion 
of this report. 



9. Director' Evaluation: 

The overall evaluation of the presession was that it w'as quite successful. 
This conclusion Is based upon an analysis of the comments supplied by the 
participants at the end of the five days and a consideration of the extent to 
which the oblectives of the presession were achieved. While it is recognized 
that the stated ob{ectIves are not manageable within a five-day program, it 
appears that the participants came away from their experience with more than 
just an awareness of the possibilities of fleld-orionted research. The par- 
ticipant-staff consultations near the end of the program indicated that several 
group members were able to apply their -knov/ledge and skills to the Individual 
proiects they were engaged in back at their home base. The consultation 
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Hme may have been the most product! v/e segment of the presossion and will 
be expanded in future v/orkshops. 

While the staff is to be considered excellent for their individual presentatioi 
command of their subject matter, etc,, it v.^ould have been more beneficial 
had their efforts been more coordinated, sequential. It is expected that the 
compileie pf'esentation will brcome more effecllve v/ith experience. 

The number of participants was much smaller than expected. This may have 
been due to the later announcement of the presest.ions to the APGA msmber- 
ship. The rmall number fostered desirable staiT-participant interaction and 
relationships. It Is my impression that the informality resulted in considerable 
“peer learning. " 
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PRESESSION V 



1. Title; PROBLEMS OF RESEARCH SUPERVISION AND CONSULTATION 

2. Staff; 



Chris D, Kehas 
(Director) 


Claremont Graduaie School 
• Claremont, California 


Ricardo GuHcrrez 


Claremont Graduate School 
• Claremont, California 


Forest Harrison 


Claremont Graduate School 
Claremont, California 


Laurence Innaccone 


Ontario Institute for Studies In Education 
Toronto, Ontario, Canada 


Francis W. McKenzie 


The public Schools of Brookline 
Brookline, Massachusetts 


Norman A. Sprinthali 


Harvard Uni vei si ty 
Carnbridge, Massachusetts 



3, General Description: 
Statement of Need 



The focus of this presession was on operations associated v/ith the systematic 
supervision of research and on perspectives toward the conduct of research. In 
mos^t circumstances, the only research most professionals conduct is that which 
is associated with their own academic degree programs; in many degree pro- 
grams, the student is not offered any practice in research. Perhaps more 
unfortunately, doctoral candidates receive no systematic training or education 
in how to supervise their own students when they assume positions of leader- 
ship Tn school systems, state departments of education, or private or public 
agencies. The development of skills in the supervision of research, then, is 
k. too often left to accident or circumstance. 

4, Purposes and Objectives; 

The activities of rhis presession focused on instructing graduate advisers 
and school guidance leaders and had the objective of improving the quality 
of research conducted in education by guidance students and guidcnce 




staff members. The direction of instruction was two-fold: (1) on pai'spec- 
tives regarding tfv conduct of research, and (2) on the development of 
skills in the supervision of research. 



Schedule: 

The training session consumed five days from Saturday, November 7 
through Wednesday, November 11 with daily programs from 9:00 a.m to 
5;00 p.m. 

The session was held In meeting rooms at the Pick “Congress Hotel in 
Chicago, Illinois, Unfortunately, due to other use, ir was not possible 
to schedule the session in the same rooms during the entire five days. 

Each day in the mornings, we mat as one large group. The mornings 
involved a presentation by a staff member, which was followed by discussion. 
In the afternoons, the participants were separated into small groups centered 
about their research problei, s and interests; each group had a staff member(s) 
who was conversant with that problem area. We first broke into three groups 
dealing with (1) evaluation and research design, (2) counselor effectiveness, 
and (3) supervision and university-fieid relationships. Staff discussion which 
followed the endof the first day revealed an overlap of participant interes . 

Th is led to o decision to dissolve group 2 and place its members into one o" 
the other two groups. Each of the two remaining groups then had twe .aff 
members as .©sources. 

The morning discussion and the small group work often continued over 
into lunch and dinner gatherings. 

■In addition, every afternoon before dinner, the staff held prolonged and 
intensive discussion wherein the events of the day were reviewed, and the 
plans for the next doy reassessed and revised. These discussions were 
essential to the development and tailoring of th© program lo the needs and 
concerns of the participants in concert with the ob|ectives of the presession. 

Participants: 

Th era nine malos and eleven females represenHng collages and uni“ 
versUies, local school districts, and public and privlate agencies. The 
distribution of parHcipanfs by sex, place of residence, educaHona! attain*^ 
manf, and nature and place of employment is outlined below. 



Since this was ci regional rather than a national meeting, and since 
no stipends of any sort v/ere availoble for the participants, the presession 
attracted primarily participants from the Midwest with, however, notable 
exception. There was representation from the South (Arkansas), East 
(Now York, Pennsylvania) and Ale ka. 



Sex 



Number 



Highest Educational Degree Obtained 



Male 

Female 



9 

n 

N -20 



Place of Resideiico 



Region 



Midwest 



South 



West 



State 



Number 



Illinois 

Ohio 

Wisconsin 

Indiana 

Michigan 

Minnesota 

Missouri 



Arkansas 



Alaska 



6 

3 

3 

1 

1 

1 



New York 1 

Pennsylvania 1 



Masters 

Masters and Certificate 
Doctoral Candidate 
Doctorate 



16 



5 

1 

3 

11 

N «20 



Nature and Pl ace of Employment 
Employer Position Number 



Higher Education 

Professor 

Associate Professor 
Assistant Professor 
Instructor 



6 

5 



14 



Local Schools 



Coordinator of 
Guidance 1 

School Counselor - 
Counseling Psycholo- 
gist 2 

Assistant Director of 
Research, Cooperative 
School Rehabilitation 
Center i 



Total 20 
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Agency 



Employment Assistance 
Officer 1 

Senior Research 
Assistant 1 
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7. 



Insh'ucl'ional Maierials; 



Applic is wera requested to complete a Planning Data form for staff 
use and to bring to the session "a problem or set of problems" which they 
were experiencing in their supervision and direction of research with 
which they needed assistance. These materials were used throughout the 
session. 

8. Evaluation: 

As planned, the evaluation was accomplished through a questionnaire 
completed by the participants. We sought their ]udgement on a number of 
aspects. The questionnaire solicited responses to open-ended questions as 
well as ratings on a four-point scale, indicating the degree to which the 
respondent agreed with soma descriptive statements. 

Participant Ratings 

Ratings were elicited on statements describing the substance 
of the program, program organization, and program setting, 

1 . Program 

The participants were asked to indicate hov/ valuable 
the various actlvities--individual presentations, ensuing 
discussions, and ^he group meetings--weiG in helping them 
meet program objectives. In acquiring knowledge, and in 
developing skills of research supervision . A four-point scale 
of value was offered- 1, Not of value; 2, Only slightly 
valuable; 3, Moderately valuable; and 4, Extremely valuable 
Space was provided following each item to allow'opportunity 
forth participant to clarify and/or qualify his response. The 
mean rankings are summarized in Table I . 
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MEAN RATINGS OF PROGRAM 



Table 1 













Acfivlty 


Presentation 


Mean Ratings 

Discussion 


1 . 


Fantasy and Reality In Research; 








The Unproductive Paradox 


3.S 


3.5 


2. 


The Conduct of Research: A • 








cess 


3.6 


3.9 


3. 


Strategies for Institutional 
Change 


3.6 


3.7 


4. 


The Research Process: Procedures 
and Proceedings 


3.4 


3.9 


5. 


Field Studies: Sociological and 








Anthropological Approaches 


3.6 


3.6 
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For the individual presentations, the mean ratings ranged 
from 3.4 to 3.6 indicating a value niidv/ay betvreen "moderate" 



received the lowest ranking. 

With the discussions, the mean rating:; were "higher ranging 
from 3.6 to 3.9. The 3.9 rating was attributed to both of the 
discussions which followed the presentations by the staff member 
whose competence was in the area of measurement, evaluation, 
and statistical analysis. This result is to be contrasted wjth the 
low rating given to his’sscond, more technical presentation as 
noted above , 

The task group meetings received an oqually high mean 
rating of 3.6. The ratings given to each of the two groups 
were examined separately and there are no differences between 

them. 

2, Program Setting 

The participants were asked to indicate the extent to 
which they agreed v>''th a series of four statements about the 
situational context of the presession. A four-point scale was 
offered: 1, Strongly disagree; 2, Disagree; 3, Agree> 4, Strongly 
agree'". Here again space. was provided for elaboration of par- 
ticipant responses. The statements and the mean rankings are 
as follows: 

Pre-program Information was adequate fpr my 

use In deciding v/hether or not to apply. 2.9 

Pre-program information accurately described 

the program offered. 2.5 

Arrangements for living accommodatFons and 
meals were satisfactory, 3.1 

physical anangements (room, lighting equipment, 
etc. were satisfactory) 2,9 

The daily schedule of activities was satisfactory 




ei'abie" would be. a good way 
The most "tochnica!" presentation 



" woui 



(9-5:00) . 



3.7 



3. 



program Organizcifion and Administration 



A sarios of stotcmonts lofen'itig to the oi'Qonizaiion ond 
administration of the program wore offered to the participants 
for their evaluntlon. Their agreement was expressed os noted in 
Pngrani Setting above. The mean rankings of the statements are 
as follows: 



Qualifications and competencies of th© staff were 
satisfactory, 3,9 

The scope and sequence of learning experiences 
Were satisfactory. 3.5 

The balance between forma! ond informal activi- 
ties was satisfactory. 3,6 

There was'^sufficient fime for individualized activi- 
ties. , 3.4 

There w'os opportunity for each participant to express 
his ideas and viev/s. ■3,7 

I 

There was sufficient time for meeting infoimally with 
other participants. 3.4 

J 

Other participants were readily accessible. 3.3 

There was sufficient time for meeting with staff, 2.7 

Staff members were readily accesstbie. 3,3 

New acquaintances were made or old ones renewed 
which will be helpful In future profassional work, 3.7 

A presession on this topic should be offered next 
year. 4.0 



It is quite clear that there is sufficient evidence that the substance of the 
s program was of considerable value to the participants. The discussions 

following generally were deemed more valuable than the presentations per se, 
perhaps, because they offered opportunity for participants to come to grips 
with substanco itself in individualized and personal ways. This was es- 
pecially true where the presentations were of o technical nature, that Is, dealing 
Y/lth the actual procedures and proceedings of the reseorch process. The group 
meetings also held considerable va? je for the participants as these sessions 
allowed opportunity for consideration of individual problems and concerns. 
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Pro-profjram informatton was deemed less than adequate and somewhat 
"misrepresentative" of the actual experience. The latter was, perhaps, 
somavrhat unavoidable as most of the ^taff were unactjuaintec! with, and had 
never worked with, each other. The link among staff and betvyeen staff 
and program v/as the Director and his proposal. This situation will be moire 
full/ discussed below. The point Is that it was impossible to tell in advance 
what would emerge from the meeting of these staff members with these 
particular participants. 

The occasion for the meeting was, of course, circumscribed by the pro- 
posal; however, the nature of the actual experience was not. For this 
reason, during the introduction to the presession, we shared the original 
proposal with the participants. We v/Ished to take the mystery and mystique 
out of our efforts and to have participants join with staff in accomplishing 
the mutual obiectives sot for our moeting. 

The living arrangoments were satisfactory but it was more a question of 
putting up with the constraints of the experience rather than enjoying them. 
Since no stipends were available, and since only the travel of some partici- 
pants was supported by their home offices, everyone was on a limited budget 
that was sevefly strained by living at a downtown Chicago hotel. 

Despite these limitations, strong support was expressed for the daily 
schedule of activities which had been established, 

■ The organizatiotf and administration of the program was in general deemed 
very satisfactory. The qualifications and competencies of the staff svere deemed 
highly satisfactory . The scope and sequence of the activities, the balance 
between formol and informal activities, and the opportunity for each partici- 
pant to express his ideas and views were all commended highly by the 
participants. A colleagueship, a feeling of mutuality of professional interests 
was developed as fhe participants reported that new acquaintances were made 
and/or old ones renewed which would be helpful in future professional work, 

A sufficiency of time was reported for individualized activities, group 
activities, meeting informally with other participants, but much less so for 
meeting vrith staff despite fhe efforts outlined above. 

There v/as little indication available from those who expressed an in- 
sufficiency of time. 

The "insufficiency of time" was seen in part as a question of desiring even 
more than was available, in part not being able to participate more fully 
because of other commitments, and in part because of a reluctance and hesi- 
tation to infringe on staff. We should conclude that we could have taken the 
initiative even more with those who were retiring and reluctant, 
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The mosi- yummai-ive evaluafion possible is, perhaps, in the quesHon of 
wheiher or not a presession on this topic should be offered next year. To a 
person, the participants aii said strongiy ''yes.” 



Director's Evaluation; 

4 

The primary purpose of this APGA research training session on research 
supervisionaand consultation was to equip graduate advisors and school 
guidance leaders with some of the knowledge and skills necessary to im- 
prove the quality of research conducted in education by guidance students 
and guidance staff. The direction of instruction was two-fold: (1) on 
persDectIves regarding the conduct of research, and (2) on the development 
of skills in the supervision of research. 

Analysis of the results as revealed in the questionnaire completed by 
participants indicates that the ob|ectlves of the session were achieved to 
a high degree. New Ideas and knowledge were imparted and a of 
reconstruing the research process that held promise of power was offered. 
Participanfs reported renewed confidence in their abilities to conduct 
and supervise research. Participants' plans for using this experience on re- 
turn to their work settings were many and varied. 

The substance of the program as experienced through presentations, dis- 
cussions, and small group work was judged to be of considerable, if not 
extreme, value, THe competencies and expertise of the staff were evaluated 
as highly satisfactory. 

The organization and administration of the program were found to be very 
satisfactory. The scope, sequence, and balance of activities was highly 
satisfactory. There v/as great opportunity for each participant to express his 
ideas and views. Time was sufficient for the various activities but there v/as 
some concern expressed about adequate time for meeting with staff. 

All the participants felt that a presession of this nature should be offered 
next year, and most said they would be willing to pay a fee for tuition if 
federal support was withdrawn. 

. The reality of this conference and Its staging had no base other than the 
"vision" of the Director who had worked in different settings with each of 
the staff individually and felt that they not only shared the "vision" but also 
were working in their own ways toward achieving the common objectives 
described in the proposal . 

As such, there was much work needed to get staff together, comfortaole 
with each other, and developing ways of working together. It soon became 



evident to us that the staff needed long and intensive discussions among 
ourselves to operationalize and concretize the vision, each member's role 
In it, end our relotionsldps to one another. This, of course, becomes 
concsptualized as staffing and the work as pre- and post-meeting planning 
but the dynamics of the process are never fully revealed, 

As a consequence, staffing time “-going from 5:30 to 8:30 on a number of 
even!ngs"-“did intrude some into the time available for some participants. 
Staff, however, was keenly aware of this and redoubled efforts to make all 
other time most available to participants and productive. 

In the end, however, the assessment of the eKperience Is best evidenced 
by the fact that staff — to a one — felt we had developed something worthwhile 
and expressed a desire to offer this presession again. 

In this regard, ! would like to make as strong a recommendation as is 
possible that this presession activity be maintained and expanded, and that 
it receive the full and continuing support of tiie APGA Research Committee, 
and of the research branch of the USOE, The value of these presesions is 
inestimable. The provision of opportunity for those In full-time employment 
In the field to come together with appropriate resources to get some training 
In areas where they fee! they have a need is an excellent and invaluable 
experience— “for all concerned. In some cases, it is a supplement, and in 
others a complement, to their previous graduate training. In either event, 
the experience is more intensive, more focused, and more individualized, 

Ths presssslon Is a service which should have graaf* payoff m stimulating 
and Irnproving the cjuality of research activities in the fields ond in rnciking 
research in education conducted by the University more powerful* It is a 
bridge for dev^eloping and maintaining a meaningful partnership between the 
university community and those in the field. 
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